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TRA NSFORMATION STRUCTURES FOR APPROXIMATIN G 

COLOR MAT CHING FUNCTIO NS * 

BACKGROUND OF THE INVENTION 

The invention relates to methods of color sensing and estimation. More particularly 
5 the invention relates to techniques for determining RGB filter set and color estimation 
performance for RGB LED color sensing. 

In the field of color sensing it is known that any instrument or process used to 
distinguish or sense colors as the human eye does must have spectral responses which 
correspond to some linear transformation of the CIE color mixture 

1 0 functions x(X ) , y ( X ) , z( X ) . In color photography this condition is known as the Luther-Ives 
condition. There are infinitely many real coefficients ai, a2 and a3, such 
that C(X) = x(X) + a 2 y(X) + a 3 z(A), represents an equivalent new color matching function 

C(k). All functions of the C(A,) family are equivalent under matrix transformation. 

There is much greater freedom when using color filters for color sensing to 
15 approximately realize C(X) for a set of coefficients instead of physically realizing the CIE 
color matching functions. Since there are infinitely many equivalent C(A,)'s, an appropriate 
set of C(X)'s must be determined for a given color filter set. 

In order to be approximated by practical color filters, the new transformed color 
matching functions need to satisfy three conditions: 1) C(k) is positive or zero throughout the 
2 0 entire spectral range; 2) C(A,) has a single peak; 3) the overlaps between the three C(A.)'s are 
as small as possible. 

One transformation matrix satisfying the above conditions is the well known 
Mac Adam's matrix given by: 
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The Mac Adam's matrix satisfies the conditions for color matching functions that may 
be realized by real filters and is therefore of use in the design of filter sets for specific color 
sensing applications. Custom designed filters sets are particularly expensive to implement, 
- 5 especially when the filter must be designed in a specialized shape. For many applications of 
color sensing, the custom designed filters necessary for optimal estimation are too expensive. 
It would be desirable to provide a method of utilizing existing low cost filters for sub-optimal 
color sensing to overcome these and other limitations. 

SUMMARY OF THE INVENTION 

10 The present invention is directed to a system and method for determining RGB filter 

set and color estimation performance for RGB LED color sensing. Color filter performance 
for an RGB LED color sensing system is substantially optimized by determining 
transformation parameters to optimize spectral approximation. A calibration is provided to 
allow adjustment of parameters. 

15 In accordance with the invention, a method for determining RGB filter set and color 

estimation performance for RGB LED color sensing is provided. Means for constructing a 
criteria function describing an error between desired color matching functions and a spectral 
response of an RGB filter set are provided. Means for determining RGB filter set response 
characteristics based on the criteria function are also provided. Finally, means for 

2 0 determining color estimation parameters for substantially optimal color estimation with the 
RGB filter set based upon the determined RGB filter set response characteristics are 
provided. 

In accordance with another aspect of the invention a computer readable medium 
storing a computer program is provided. Computer readable code for constructing a criteria 

2 5 function describing an error between desired color matching functions and a spectral response 

of an RGB filter set is provided. Computer readable code for determining RGB filter set 
response characteristics based on the criteria function is also provided. Finally, computer 
readable code for determining color estimation parameters for substantially optimal color 
estimation with the RGB filter set based upon the determined RGB filter set response 

3 0 characteristics is provided. 

The foregoing and other features and advantages of the invention are apparent from 
the following detailed description of exemplary embodiments, read in conjunction with the 
accompanying drawings. The detailed description and drawings are merely illustrative of the 
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invention rather than limiting, the scope of the invention being defined by the appended 
claims and equivalents thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 shows the CIE color mixture function and the MacAdam's color matching 
- 5 functions; 

FIG. 2 is a flow diagram illustrating a method for determining RGB filter set and 
color estimation performance for KGB LED color sensing; 

FIG. 3 shows a flow diagram illustrating a process for determining color estimation 
parameters for RGB LED color sensing; 
10 FIG. 4 is a block diagram illustrating an exemplary computer system that may be used 

to implement the method of the invention; and 

FIG. 5 is a block diagram of an exemplary RGB color sensing and estimation system 
to which the invention may be applied. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
15 The present invention is directed to a system and method for determining RGB filter 

set and color estimation performance for RGB LED color sensing. FIG. 1 contains spectral 
response plots of the CIE color matching functions, x(A) 120 , y(JL) 130, and z(A) 140, and 
corresponding color matching functions xmc(A) 150 ,ymc(A) 160, and zmc(X) derived 
from the MacAdam's matrix. Note that the function zmc(A), while present, is not visible on 
2 0 FIG.l as z(Z) matches zmc(A). FIG. 1 is provided for illustration and will be recognized by 
those skilled in the art. 

A criteria function describing an error between desired color matching functions and a 
spectral response of an RGB filter set is constructed. RGB filter set response characteristics 
based on the criteria function are then determined. Finally, color estimation parameters for 

2 5 substantially optimal color estimation with the RGB filter set are determined based upon the 

determined RGB filter set response characteristics. Additional steps not elucidated may 
occur within the following description and some steps may be combined, omitted or occur in 
a different order without departing from the spirit and scope of the invention. 

FIG. 2 shows a flow diagram illustrating a process for determining RGB filter set and 

3 0 color estimation performance for RGB LED color sensing. Process 200 begins in step 210. 

A criteria function describing an error between desired color matching functions and the 
spectral response of an RGB filter set is constructed in step 210. The criteria function is a 
linear vector function bounded over a spectral bandwidth. In general, the criteria function 
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describes the performance of a color sensing or estimation system typically comprised of a set 
of color filters, a set of RGB LED illuminants and a set of color sensors. An advantage of the 
present invention is that the system color filters may be of the low-cost film variety. The 
criteria function includes a matrix of the spectral responses of red, green and blue LED's 
5 respectively, and an unknown constant correction vector ' V that is subtracted from the 
Mac Adam's matrix functions and the RGB filter sensitivity functions with an unknown 
constant matrix "M." The criteria function therefore provides a means to determine system 
filter performance through evaluation of the unknown constant vectors. If a computer 
implements step 210, a database may be automatically accessed to obtain various data to 

1 0 construct the criteria function such as the system RGB LED illuminant spectral data and the 
system filter spectral response data. 

In step 220, RGB filter set response characteristics are determined based on the 
criteria function. Response characteristics include constant terms for the vector "n" and the 
matrix "M." The criteria function is evaluated to determine values for "Af ' and In one 

1 5 embodiment, the criteria function is a constraint set criteria function with a minimum value 
constraint. In the present discussion, the minimum value of the criteria function with 
constraint set "M" and ' V is a color filter performance index for the system RGB LED 
illuminants. Therefore, the scalar values of "M" and 'V that result in a minimum value 
criteria function determine the system color filter performance. 

20 In step, 230 color estimation parameters for substantially optimal color estimation 

with the RGB filter set are determined based upon the system RGB filter set response 
characteristics determined in step 210. Step 230, occurs at any time after the determination of 
"/*" and "A/" in step 220. Step 230 comprises one or more color estimation parameter 
determinations. In one embodiment, color estimation parameters includes structures 

2 5 describing localized spectral approximations with weighting functions. In another 

embodiment, color estimation parameters includes structures describing a new set of 
estimated tristimulus values of a white light illuminant formed by an RGB LED set. In yet 
another embodiment, color estimation parameters includes structures describing a color 
calibration for a color estimation system. Substantially optimal color estimation is sub- 

3 0 optimal estimation that approaches the ideal of the CIE color mixture functions or a linear 

combination equivalent, while remaining sub-optimal. The color estimation parameters 
determined in step 230 provide inverse transformation structures that allow substantially 
optimal color sensing and estimation with low-cost color filters. The criteria function J is 
generally represented by an equation in the form: 
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where r(X), g(X) and b(X) are positive real continuous sensitivity functions of the RGB 
filter set and X e cr == [380, 780] nm, r ledW , G LED (A) and B L£D (A) are the spectra Q f red, 
green and blue LED light sources respectively and where 



xmc(A,),ymc(A),and zmc(X) are a get of colof matc hing functions, and Mis a 3x3 constant 
matrix and n is a 3x1 constant vector. 

If a computer implements step 230, a database may be automatically accessed to 
obtain various data to determine color estimation parameters. 

FIG. 3 shows a flow diagram illustrating a process for determining color estimation 
parameters for RGB LED color sensing as in step 230 of FIG. 2. Process 230 begins in step 
340. In step 340, spectral approximation functions x ,y , andz for the RGB LED light 
sources are constructed from the "M" and " determined by evaluating the criteria function. 
The spectral approximation functions include a weighting function. The spectral 
approximation functions are represented by an equation in the form: 
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where u is a unit step function. 

In step 350, estimated tristimulus values are determined based on the spectral 
functions estimated in step 340. The system color sensors equipped with the system color 
filter set estimate the new tristimulus values based on the white light emission of the system 
RGB LED's. The estimated tristimulus values X , Y , Z are determined according to the 
relationship represented by the equation: 
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(3) 



where P(X) = R LED (A) + G tat {X) + B LED {X) . 

In step 360, a color sensing calibration is implemented. The calibration occurs after 
the determination of tristimulus values in step 360. A calibration matrix is determined and 
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applied to correct for error in the system color estimation. The calibration is determined 
according to the relationship represented by the equation: 
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where X, Y and Z are tristimulus functions of the RGB LED illuminants and where 
5 M C ai is a calibration matrix and Mc A is an inverse MacAdanTs matrix. 

FIG. 4 is a block diagram illustrating an exemplary computer system 400 that may be 
used to implement the method of the invention. FIG. 3 shows a computer system 400 
containing: an I/O device 410; a processor 420; a user interface 430; memory 440; a display 
450; removable storage 460; a bus 490; and, mass storage 470 containing a database 475, 
10 programs 476 and an operating system 477. In FIG. 3 the I/O device 410, the processor 420, 
the user interface 430, the memory 440, the display 450, the removable storage 460 and the 
mass storage 470 are all shown coupled to the bus 490. The I/O device 410 is additionally 
shown enabled for communication external to computer system 400. 

The I/O device 410 is a device capable of bidirectional data communication with a 
15 device external to the computer system 300. Examples of I/O devices include serial, parallel, 
USB, Ethernet and IEEE 802.1 1 compliant wireless devices, for example. 

The processor 420 is a computing device usually containing memory and data control 
capability, such as caching and the like. The processor 420 may be integrated with 
supporting hardware such a video controller, a storage device controller and the like. The 

2 0 processor 420 generally executes instructions of a computer program such as program 476, 

for example. 

The user interface 430 is a device such as a keyboard, a mouse, a pointing device, a 
pen, a microphone or another device used to provide a data entry interface with a user of the 
computer system 400. 

25 The memory 440 is a hardware or virtual storage for computer code and data that the 

processor is manipulating. Memory 440 includes all dynamic memory external to the 
processor including video memory, additional cache memory and the like. Portions of mass 
storage 470 may also be used to provide virtual memory that may be used interchangeably 
with the memory 440. 

3 0 The display 450 is a visual display such as a CRT, LCD, plasma or projection display 

used to provide a user with a visual interface with the computer system 400. 
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The removable media 460 is any device that provides a removable medium for storing 
computer code or data such as a magnetic disc drive, a writable optical disc drive or the 
equivalent. 

The mass storage 470 is any device that provides storage for computer code and data 
- 5 such as a hard disk drive a recordable optical medium and the like. In one embodiment, the 
mass storage 470 is provided by a second computer server system over a network (not 
shown). The mass storage generally contains the operating system 477, programs 476 and 
may include a database 475. Programs include applications for execution by the computer 
system 400. 

1 o The bus 490 is a bidirectional communication device that enabled data 

communication between the various devices of computer system 400. The bus may include a 
processor and other logic devices to enable multiple data clock speeds and protocols 
depending upon the connected devices. 

FIG. 5 is a block diagram of an exemplary RGB color sensing and estimation system 
15 500 to which the invention may be applied. In FIG. 5 the color sensing system is comprised 
of an RGB LED illuminant 510, a color filter 520 and a color sensor 530. The RGB LED 
illuminant is generally comprised of a trio of a red, green and blue light emitting diodes. The 
RGB LED's have tristimulus values X, Y and Z respectively. The color filter 520 is 
generally a trio of red, green and blue filters of the polycarbonate film variety and 

2 0 equivalents. The color sensor is generally a trio of red, green and blue color sensors. 

Typically, the color filter 520 is attached to the color sensor 530; however, it is not necessary 
for the operation of the color sensing system 500. 

An example of the system and method of the invention in operation is now provided. 
However, the following illustration is merely an example of the manner in which the 

2 5 invention may be practiced and in no way describes all applications or cites all known 

embodiments of the invention. 

A computer system, such as computer system 400 of FIG. 4, enabled to implement the 
invention is configured to access a database containing low cost color filter and RGB LED 
data based on the manufacturer and product code and the like. A user provides other data 

3 0 concerning the color estimation system components, such as specific RGB LED units and 

color sensor units and the model number of the filter selections. The computer then accesses 
the filter data and constructs a criteria function. The computer then determines the filter set 
performance and provides values for "n" and "M." The computer then constructs 
approximated spectral response functions based on the determined "n" and "M" The 
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computer then calculates estimated new tristimulus values for the approximated spectral 
response functions. A color calibration matrix is then determined by the computer based 
upon the estimated tristimulus values and the actual tristimulus values for the system RGB 
LEDs as provided in the computers database. In this manner, a calibrated substantially 
optimal color estimator for an RGB LED illumination system is designed. 

While the preferred embodiments of the invention have been shown and described, 
numerous variations and alternative embodiments will occur to those skilled in the art. 
Accordingly, it is intended that the invention be limited only in terms of the appended claims. 
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